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Overview 


Background  -  Why  investigate  optic  flow? 
Optic  Flow  (OF)  definition 
Review  of  current  OF  efforts 
Specific  challenges  for  missile  application 
Goals  for  AFRL/MN  effort 


Background 


Modern  smart  munitions  typically  have  two  sensors 
used  for  guidance: 

-  IMU  (Inertial  Measurement  Unit) 

-  Seeker 

To  make  these  affordable  while  still  meeting  required 
levels  of  performance,  some  tricks  are  used  e.g.  low  quality 
IMU  can  perform  adequately  if  INS  solution  uncertainty 
can  be  bounded.  One  way  to  do  this  is  by  coupling  INS 
with  GPS  receiver.  However,  we  are  now  looking  to  other 
sensors  to  accomplish  this  same  goal. 


Why  investigate  Optic  Flow? 


Growing  need  to  mitigate  effects  of  GPS 
jamming 

OF  could  be  used  to  bound  errors  on  INS 

OF  could  be  used  for  target  detection 

Part  of  a  larger  program  (FUSN)  seeking  to 
achieve  Full  Use  of  Sensors  in  Navigation 


FUSN 


(Full  Use  of  Sensors  in  Navigation) 


Improving  performance  all  components 

(seekers,  airframe,  propulsion,  autopilot  design,  fuzing,  warhead, 
etc.)  andfWTig^^^  iltiffifiTg  all  information  obtained  by  each. 


Typical  Component  Use 
Navigation: 

INS,  GPS 

Guidance: 

INS,  GPS,  Seeker 

Controi: 

INS,  Airframe 
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FUSN  Integration 
Navigation: 

INS,  GPS,  Seeker, 
Airframe 

Guidance: 

INS,  GPS,  Seeker, 
Propulsion,  Airframe, 
Fuzing 


Controi: 

INS,  Airframe,  Seeker 


Defining  Optic  Flow 

a.k.a.  structure  from  motion,  visual  flow,  kinetic  depth 


“Opening  the  eyes  of  the  weapon.”  The  2  dimensional  flow  field 

What  is  ODtiC  flow?  generated  by  ealeulating  the  veloeity  field  properties  (gradient,  curl, 

'  divergence)  of  objects/features  moving  across  an  image  plane. 

Egomotion  is  the  motion  of  the  observer  (camera).  It  can  be  extracted 
What  is  ©gomotion?  from  optic  flow  data  when  the  appropriate  conditions  &  assumptions 

are  satisfied. 


General  Comments 
about  these 
approaches 


How  can  we  use 
optic  flow  to  augment 
guidance  and 
autopilot  functions? 


Energy-Based 


Optic  Flow 
Processing 
Algorithms 


Differential 


Region-based 

Matching 


Phase-based 


Other 


OPTIC  FLOW 

RELATIVE  MOTION  FROM  THE  SEEKER 


figure  .i-55-  js  example  cjf  tUm'  indLced  hfv  mfXLon  The  arnrsv's  represenl 

aiij^uhr  veEocJties.  which  are  '/ero  directly  ahrcid  and  behind.  (Repriniec.1  fmTti  J  J 

GibiMin,  The  Setises  Cousfdereif  m  tenepfint!  Sy'SJetfts.  H<*ufth(on  MifTlin. 

1966,  %  9.3.  Cop>Ti|^ili(  ^  ISnui^fnoia  Mifflin  Ct^mpany.  t/sed  fcrt-  permission.) 


Current  Optic  Flow  Technology 

There  are  many  algorithms  available  to  calculate  OF 
yet  very  few  to  turn  OF  into  egomotion 

Roboticists  usually  solve  a  2D  egomotion 
problem. .  .we  need  the  full  3D  solution 

Most  algorithms  use  a  single  forward  looking  sensor 

Very  few  demonstrations  of  useful  OF  in 
aircraft/missile  applications 


specific  Challenges  for  Missile  Application 

•  Need  basic  research  to  address: 

-  Optimal  number  of  sensors 

-  Optimal  look  directions 
of  sensors 

-  Optimal  resolution, 
sampling  rate,  field  of  view 
wavelength,  etc. 

•  Issues  associated  with: 

-  Use  of  OF  data  within  the  GNC  loops 

-  Closed  loop  stability. .  .what  are  the  requirements  on  the 
stability  of  the  OF  and  egomotion  solutions? 

-  Frame  rates 

-  Nonlinearities 


OPTIC  FLOW 

CURRENT  SEEKER  OPTIONS 


TECHNOLOGY 

ADVANTAGES 

DISADVANTAGES 

LADAR  (SCANNING) 
FLASH  LADAR 

•  HIGH  SPATIAL  RES,  3  D 

•  HIGH  SPATIAL  RES,  3  D 

•  WEATHER,  SCAN  TIME 

•  WEATHER 

PENETRATION 

PASSIVE  MMW 
IMAGING 

•  WEATHER 

PENETRATION 

•  LOW  SPATIAL 

RESOLUTION,  SCAN 
TIME,COST 

SAR 

•  WEATHER 

PENETRATION 

•  RELATIVELY  LOW 
SPATIAL  RESOLUTION, 
REQUIRED  PROCESING 
LOAD,  SCAN  TIME,  COST 

IMAGING  IR 

VISIBLE 

•  HIGH  SPATIAL 
RESOLUTION, 
MULTISPECTRAL 

•  HIGH  SPATIAL  RESOL, 
COTS,  LOW  COST, 
MULTISPECTRAL 

•  WEATHER 

PENETRATION 

•  WEATHER 
PENETRATION,  ONLY 
WORKS  IN  DAYTIME 

Goals  for  the  AFRL/MN  Research 


Build  a  testbed  to  address  specific  challenges 

-  Simulation,  Hardware-in-the-loop,  flight  vehicle 

What  is  the  best  way  to  use  the  data? 

-  Benefit  for  GPS  antijam? 

-  Lower  cost  IMUs? 

-  Targets  in  clutter? 


Optic 

Axis 


On  FPA 
Processing 


Determine 
Optic  Flow 


Determine 

Egomotion 


Blend  seeker 
output  with 
IMU  output 


Goals  for  the  AFRL/MN  Research 


Build  a  testbed  to  address  specific  challenges 

-  Simulation,  Hardware-in-the-loop,  flight  vehicle 

What  is  the  best  way  to  use  the  data? 

Also  seeking  to  demo  current  “best  capability” 

-  Applied  Research... where  are  the  existing  bottlenecks? 


V  Optic  Flow  Initiative  AFRL/MNG 


Engineering 


Bio-neuro 


Bio-behavior 


Support 


Chnosp  nntirs 


HWTT.  Test 


Insert  algorithms  into 


Goals  for  the  AFRL/MN  Research 


Build  a  testbed  to  address  specific  challenges 

-  Simulation,  Hardware-in-the-loop,  flight  vehicle 

What  is  the  best  way  to  use  the  data? 

Also  seeking  to  demo  current  “best  capability” 

-  Applied  Research... where  are  the  existing  bottlenecks? 

Investigate  cooperative  benefits  of  combining  MEMs 
IMUs  with  near  term  OF  rotational  data  i.e.  MEMS  IMUs 
have  a  weakness  that  could  be  compensated  by  OF 

Current  Focus:  Looking  for  technology  to  mitigate  effects  of  GPS 
jamming  and  increase  the  overall  robustness  of  the  GNC  system. 


Questions? 


